Edge Computing on Raspberry Pi with Movidius Neural Compute Stick

Posted on 2019-08-31 | Edited on 2019-09-02 | In Single Board Computers , ARM

Finally, I’m going to talk about Raspberry Pi a bit. It has been discussed so widely that it seems to me NOTHING special should be further talked about by me.

To write something about Raspberry Pi is to say GOOD BYE to my Raspberry Pi 3B, and also WELCOME Raspberry Pi 4 at the same time. Our target today is to build an AI edge computing end as the following image:

Raspberry Pi 3B with Intel Movidius NCS and openVINO

1. Raspberry Pi 3B vs. Raspberry Pi 3B+

Before everythig starts, let’s carry out a simple comparison between Raspberry Pi 3B and Raspberry Pi 3B+:

Raspberry Pi 3B vs. Raspberry Pi 3B+

2. Movidius Neural Compute Stick on Raspberry Pi 3B

Then, we just follow the following 2 blogs Run NCS Applications on Raspberry Pi and Adding AI to the Raspberry Pi with the Movidius Neural Compute Stick to utilize these 2 outdated products:

Raspberry Pi 3B	Intel Movidius Neural Compute Stick 1

Intel Movidius Neural Compute Stick 1 is NOT listed on Intel’s official website any more. But github support for Intel Movidius Neural Compute Stick 1 can be found at https://github.com/movidius/ncsdk.

2.1 Raspberry Pi 3B’s Wifi Module Does NOT Work Properly

2.1.1 Wifi NOT Working

I met a bug that I failed to find the solution forever. Three related forum issues are enumerated as follows, and you are welcome to carry out further investigation.

Anyway, ip -c address gives out the following ERROR message:

➜  ~ ip -c address
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: enxb827ebc1b876: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
    link/ether b8:27:eb:c1:b8:76 brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.86/24 brd 192.168.1.255 scope global noprefixroute enxb827ebc1b876
       valid_lft forever preferred_lft forever
    inet6 2001:569:7efd:8200:6cce:f005:e59c:7a4a/64 scope global dynamic mngtmpaddr noprefixroute 
       valid_lft 7455sec preferred_lft 7155sec
    inet6 fe80::a3ea:1480:f310:3f65/64 scope link 
       valid_lft forever preferred_lft forever
3: wlan0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether b8:27:eb:94:ed:23 brd ff:ff:ff:ff:ff:ff

2.1.2 Use a Wifi USB Dongle

An arbitrary 802.11 N Wifi 2.4G USB dongle is able to activate Wifi for Raspberry Pi 3B in my case. BTW, mine is EDUP EP-N8508GS.

➜  ~ ip -c address
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: enxb827ebc1b876: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
    link/ether b8:27:eb:c1:b8:76 brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.86/24 brd 192.168.1.255 scope global noprefixroute enxb827ebc1b876
       valid_lft forever preferred_lft forever
    inet6 2001:569:7efd:8200:6cce:f005:e59c:7a4a/64 scope global dynamic mngtmpaddr noprefixroute 
       valid_lft 7470sec preferred_lft 7170sec
    inet6 fe80::a3ea:1480:f310:3f65/64 scope link 
       valid_lft forever preferred_lft forever
3: wlan0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether b8:27:eb:94:ed:23 brd ff:ff:ff:ff:ff:ff
4: wlxe84e0635166d: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether e8:4e:06:35:16:6d brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.87/24 brd 192.168.1.255 scope global noprefixroute wlxe84e0635166d
       valid_lft forever preferred_lft forever
    inet6 2001:569:7efd:8200:b2b5:a216:77f6:466b/64 scope global dynamic mngtmpaddr noprefixroute 
       valid_lft 7470sec preferred_lft 7170sec
    inet6 fe80::13d6:d1dc:48ad:9dc3/64 scope link 
       valid_lft forever preferred_lft forever

To bring up Wifi is just to plug in/out the Wifi USB dongle.

2.2 Test Installation

2.2.1 Installation

2.2.1.1 NCSDK

We FIRST need to have ncsdk installed. Yup, here, as described in Run NCS Applications on Raspberry Pi, we carry out the installation directly under folder ...../ncsdk/api/src.

1 2	➜ src git:(ncsdk2) ✗ make -j4 NCSDK FW successfully installed

2.2.1.2 Caffe

Prerequisite:

boost
OpenCV

For simplicity, you can grab the above two packages directly from Raspbian’s repository. However, it seems the default boost from Raspbian’s repository does NOT support python3 but ONLY python2. Therefore, in my case, I build both boost 1.71 and OpenCV 4.1.1 from sractch from source.

Then, we build Caffe 1 from source.

2.2.2 Test NCS

Now, let’s test the installation of NCS, by the example hello_ncs_py from ncappzoo.

➜  hello_ncs_py git:(ncsdk2) python hello_ncs.py 
Hello NCS! Device opened normally.
Goodbye NCS! Device closed normally.
NCS device working.

2.2.3 Test Simple Image Classification

Stereo Vision on VCSBC nano Z-RH-2 - PART I

Posted on 2019-08-30 | Edited on 2019-09-02 | In Machine Vision , FPGA

Today, we are going to talk about a fabulous project: stereo vision on a zynq-7010 board.

1. VCSBC nano Z-RH-2

1.1 Hardware

We are using a VCSBC nano Z-RH-2 board for today’s experiment. The board adopted looks like the following:

Front	Back	Connector

More detailed specifications, please refer to Vision Components’s official website.

1.2 Software

After you set up a static IP for this Vision Components SBC, it’s pretty straightforward to ssh into the system.

longervision-GT72-6QE% ssh user@192.168.1.79
user@192.168.1.79's password: 

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
Last login: Thu Aug 29 18:17:49 2019 from 192.168.1.200
user@VC-Z:~$

Currently, VC provides Linux Kernel 3.14.79.

1 2	user@VC-Z:~$ uname -a Linux VC-Z 3.14.79-vc-z #2 SMP PREEMPT Wed Apr 24 18:33:06 CEST 2019 armv7l GNU/Linux

And, let’s take a look at the dual ARMv7 CPUs on zynq-7010.

user@VC-Z:~$ cat /proc/cpuinfo
processor	: 0
model name	: ARMv7 Processor rev 0 (v7l)
BogoMIPS	: 1725.23
Features	: swp half thumb fastmult vfp edsp neon vfpv3 tls vfpd32 
CPU implementer	: 0x41
CPU architecture: 7
CPU variant	: 0x3
CPU part	: 0xc09
CPU revision	: 0

processor	: 1
model name	: ARMv7 Processor rev 0 (v7l)
BogoMIPS	: 1725.23
Features	: swp half thumb fastmult vfp edsp neon vfpv3 tls vfpd32 
CPU implementer	: 0x41
CPU architecture: 7
CPU variant	: 0x3
CPU part	: 0xc09
CPU revision	: 0

Hardware	: Xilinx Zynq Platform
Revision	: 0000
Serial		: 0000000000000000

2. Stereo Vision

Sorry everybody. Today, I ONLY test stereo vision on ARM. I’ll try to figure out how to flash an open source IP of stereo vision onto zynq-7010, or write my own ASAP.

Hmmmmmmmm… It’s better I keep my code in dark???

2.1 Classical Image Pairs

Let’s try out the stereo vision on some .pgm image pairs FIRST.

user@VC-Z:~/longervision$ ./pgmpair ../images/aloe_left.pgm ../images/aloe_right.pgm 
width= 1282
height= 1110
fps: 0.119696
process: 398651

My GOD… It’s UNBELIEVABLY SLOW.

aloe_left	aloe_right

aloe_left Stereo	aloe_right Stereo

2.2 Live Video Pairs

The BEST demo code to test Vision Componenets Stereo Vision is Eclipse_Example_Projects_VC_Z.

2.2.1 imageCaptureTest

#./imageCaptureTest 
0


 ----------------------------------------------------------------------- 
  VCCapt @0xbe87153c                                    Sensor Count: 2  
 ----------------------------------------------------------------------- 
                                                                         
                  Camera Type :  NANO Z RH Rev.0                         
                Sensor 0 Type :  E2V_EV76C560ABT_1_0                     
                Sensor 1 Type :  E2V_EV76C560ABT_1_0                     
                                                                         
   Trigger        Source      :  IMM                                     
                                                                         
     ___________________________________________________________________ 
     Sensor[ 0]:         Shutter:     12345 us,  Gain: 0.00              
                                                                         
                   x0, y0       :  (    0,    0)                         
            binX,     binY      :  (    1,    1)                         
        subsmplX, subsmplY, flip:  (    1,    1,0x00)                    
    (img)          dx, dy, pitch:  ( 1280, 1024), 1280                   
                                                                         
    (img) st, ccmp1, ccmp2, type:  0xb6b03080, 0x00000000, 0x00000000, 0 
                                                                         
      Description                                                        
       Sen dx, Sen dy, Sen pitch:   1280, 1024, 1280                     
       Max dx, Max dy, Max pitch:   1280, 1024, 1280                     
    Binning Max (dx, dy), Square:      2,    1,    1                     
    Subsmpl Max (dx, dy), Square:      8,    8,    0                     
       Init       st,ccmp1,ccmp2:  0xb6b03080, 0x00000000, 0x00000000    
       Init  Shutter, Gain, Type:       10000,  0.00, GREY   (0)         
                  FD, Port, Type:  4, 0, E2V_EV76C560ABT_1_0             
                                                                         
      Volatile Description                                               
            requestCaptID, State:          0, IDLE                       
          captId, TimestampTicks:          0,   6476832867277            
                                                                         
      Externals Description                                              
            pos[0-3], angle[0-2]:  [ 0.00, 0.00, 0.00],[  0.0,  0.0]     
                                                                         
     ___________________________________________________________________ 
     Sensor[ 1]:         Shutter:     10000 us,  Gain: 0.00              
                                                                         
                   x0, y0       :  (    0,    0)                         
            binX,     binY      :  (    1,    1)                         
        subsmplX, subsmplY, flip:  (    1,    1,0x00)                    
    (img)          dx, dy, pitch:  ( 1280, 1024), 1280                   
                                                                         
    (img) st, ccmp1, ccmp2, type:  0xb69c2080, 0x00000000, 0x00000000, 0 
                                                                         
      Description                                                        
       Sen dx, Sen dy, Sen pitch:   1280, 1024, 1280                     
       Max dx, Max dy, Max pitch:   1280, 1024, 1280                     
    Binning Max (dx, dy), Square:      2,    1,    1                     
    Subsmpl Max (dx, dy), Square:      8,    8,    0                     
       Init       st,ccmp1,ccmp2:  0xb69c2080, 0x00000000, 0x00000000    
       Init  Shutter, Gain, Type:       10000,  0.00, GREY   (0)         
                  FD, Port, Type:  5, 1, E2V_EV76C560ABT_1_0             
                                                                         
      Volatile Description                                               
            requestCaptID, State:          0, IDLE                       
          captId, TimestampTicks:          0,   6476832867284            
                                                                         
      Externals Description                                              
            pos[0-3], angle[0-2]:  [ 0.00, 0.00, 0.00],[  0.0,  0.0]     
                                                                         
 ----------------------------------------------------------------------- 
......

2.2.2 imageCaptFPS

03:41:47[root@VC-Z] /home/user/vc/Eclipse_Example_Projects_VC_Z/imageCaptFPS
#./imageCaptFPS 
dy= 1024  Clock=100000000  Acquisiton&Copy Duration:         28s     780685us  for 1000 Cycles ==  34.745525fps.

dy= 768  Clock=100000000  Acquisiton&Copy Duration:         28s     789899us  for 1000 Cycles ==  34.734402fps.

dy= 640  Clock=100000000  Acquisiton&Copy Duration:         28s     790000us  for 1000 Cycles ==  34.734283fps.

dy= 512  Clock=100000000  Acquisiton&Copy Duration:         28s     790012us  for 1000 Cycles ==  34.734268fps.

dy= 384  Clock=100000000  Acquisiton&Copy Duration:         28s     790005us  for 1000 Cycles ==  34.734280fps.

dy= 256  Clock=100000000  Acquisiton&Copy Duration:         28s     790000us  for 1000 Cycles ==  34.734283fps.

dy= 192  Clock=100000000  Acquisiton&Copy Duration:         28s     790021us  for 1000 Cycles ==  34.734257fps.

dy= 128  Clock=100000000  Acquisiton&Copy Duration:         28s     789984us  for 1000 Cycles ==  34.734303fps.

dy= 64  Clock=100000000  Acquisiton&Copy Duration:         28s     789987us  for 1000 Cycles ==  34.734299fps.

dy= 32  Clock=100000000  Acquisiton&Copy Duration:         28s     789997us  for 1000 Cycles ==  34.734287fps.

dy= 16  Clock=100000000  Acquisiton&Copy Duration:         28s     790017us  for 1000 Cycles ==  34.734264fps.

dy= 8  Clock=100000000  Acquisiton&Copy Duration:         28s     790002us  for 1000 Cycles ==  34.734280fps.

dy= 4  Clock=100000000  Acquisiton&Copy Duration:         28s     789985us  for 1000 Cycles ==  34.734303fps.

dy= 2  Clock=100000000  Acquisiton&Copy Duration:         28s     789997us  for 1000 Cycles ==  34.734287fps.

dy= 1  Clock=100000000  Acquisiton&Copy Duration:         28s     789994us  for 1000 Cycles ==  34.734291fps.

The above 2 examples are directly run on Vision Components’s board without display, for the given cable is of VGA connector, which is ALREADY outdated for many years. Therefore, in order to show the captured image pairs, in the next section, we’ll have to stream the captured data to a host computer, and display the real-time video pairs.

2.3 Stream/Display From Host Computer

2.3.1 Eclipse Installation

Three tools are to be prepared FIRST.

Eclipse
CDT: install by Check for Updates with p2 software repository: http://download.eclipse.org/tools/cdt/releases/9.8
Direct Remote C++ Debugging: installe from Eclipse Marketplace

2.3.2 Setup Camera as a Remote System to Eclipse

In this section, we just follow Vision Componenets Linux Getting Started for ALL configurations.

Kaggle Competition - APTOS 2019 Blindness Detection

Posted on 2019-08-26 | Edited on 1969-12-31 | In AI , Kaggle

Oh-my-god, kaggle competition about diabetis… Hmmm, I have something to do these days… It’s also a GOOD chance for me to learn some medical terms… In this blog, we’re going to try out this kaggle competition - APTOS 2019 Blindness Detection.

1. Pre-processing Diabetic Retinopathy Images

It’s NOT hard for us to locate APTOS [UpdatedV14] Preprocessing- Ben’s & Cropping, which seems to me a professional snippet of code preprocessing diabetic retinopathy images. Let’s just try it out directly.

1.1 Implementation

The implementation is cited directly from APTOS [UpdatedV14] Preprocessing- Ben’s & Cropping, with trivial modifications. You are welcome to download my snippet of code here.

1.2 Show Off Intermediately Processed Images

5 Categories	Diabetic Retinopathy Concepts

Original Images in Color	Original Images in Gray Scale

Ben Graham’s Preprocessing for Gray Scale Images	Ben Graham’s Preprocessing for Color Images

Circle Crop	Circle Crop High Resolution

Resized Train	Resized Train High Resolution

Some extentions about diabetic retinopathy are given in the end:

Heatmap	Inconsistency

Install Armbian Debian onto Longer Vision Technology H3 Board

Posted on 2019-08-25 | Edited on 2019-08-31 | In Single Board Computers , ARM

Today’s weather is perfect for this party: annual summer alumni party of Wuhan University.

Alumni	Me

Today, I’ve got another GOOD news: our ARM Linux board based on AllWinner H3 is demonstrated successful.

1. Hardware

2.1 Appearance

Yeah, this is how OUR OWN board looks like:

Longer Vision Technology AllWinner H3 Board

2.2 Specifications

From the appearance, it’s NOT hard to tell the specifications:

Device	Version	Units
USB	2.0	2
Wired	100Mbps	1
HDMI		1
Power Adaptor	5V	1

2. Flash Armbian Debian

2.1 Armbian for AllWinner H3

Armbian provides abundant info for AllWinner H3:

2.2 Armbian for Orange Pi PC

I’m so lucky today that I tried ONLY ONE TIME and have this Debian Buster with Armbian Linux for Orange Pi PC successfully installed and run on our board. You just need to download and extract Armbian_5.91_Orangepipc_Debian_buster_next_4.19.59.img out, and have it installed by dd.

2.3 Longer Vision Technology H3 Board Test

It’s NOT hard to find out your board’s IP address

either from within your router
or boot your board with a monitor and run the command ip -c address.

Now, you should be able to SSH into your H3 baord directly as follows:

SSH Into LVT H3 Board

After you run

sudo apt update and sudo apt upgrade
sudo armbian-config

you should be able to upgrade your Debian Buster with Armbian Linux from 4.19.59-sunxi to 4.19.62-sunxi.

longervision-GT72-6QE% ssh longervision@192.168.1.96
longervision@192.168.1.96's password: 
  ___  ____  _   ____   ____ 
 / _ \|  _ \(_) |  _ \ / ___|
| | | | |_) | | | |_) | |    
| |_| |  __/| | |  __/| |___ 
 \___/|_|   |_| |_|    \____|
                             
Welcome to Debian Buster with Armbian Linux 4.19.62-sunxi
System load:   0.16 0.12 0.08  	Up time:       6 min		
Memory usage:  18 % of 460MB  	IP:            192.168.1.96
CPU temp:      79°C           	
Usage of /:    2% of 58G    	

Last login: Sun Aug 25 20:13:29 2019 from 192.168.1.200

3. Issues

It’s a kind of late. Let me finish this up for now ASAP.

3.1 Hardware Issues

ONLY 1 USB 2.0 port is working properly.
It’s EASY to reach the critical temperature, as showing:

SSH Into LVT H3 Board

3.2

We really need a better low-cost chip to provide the support for:

USB 3.0
GigE

JeVois Smart Machine Vision Camera

Posted on 2019-08-23 | Edited on 2019-08-24 | In Machine Vision , ARMLinux

JeVois is an ARM Linux based camera module, delivered by JeVois Inc.. So far, this is the ONLY ARM Linux based camera module that I’m recommending, for its well-designed community as well as plenty of source code on Github.

1. Specifications

Clearly:

JeVois Hardware Page: JeVois is based on the Made In China ARM Linux chip Allwinners A33
JeVois Software Page: JeVois runs a full Linux operating system.

2. Getting Started with Jevois

The BEST place to start with JeVois is the following Youtube video:

I’m NOT going to repeat this step-by-step setup but move forward to the demonstration step directly.

3. Connect JeVois with Host

After having flashed JeVois’s TF card with the LATEST Linux image, we connect JeVois camera module into the laptop. This TF card will NOT mount onto the computer as a device automatically, but can be detected by lsusb as follows:

longervision-GT72-6QE% lsusb
......
Bus 001 Device 016: ID 1d6b:0102 Linux Foundation EEM Gadget
......

4. Simple Demonstration

4.1 Guvcview

Get Started	Image Control Default Settings

Video Control Settings 640x480	Video Control Settings 640x360

4.2 JeVois Inventor

4.2.1 JeVois Tutorial

Again, a Youtube video is suggested to follow for the demonstration:

4.2.2 My Test

You can either download JeVois Inventor directly from the Official Website, or like me, build JeVois Inventor source code from scratch, based on my own QT, etc. Anyway, after JeVois Inventor has been successfully installed, it’s the time for us to test it out.

JeVois Inventor Info	JeVois Inventor Parameters

JeVois Inventor Console	JeVois Inventor Camera

JeVois Inventor Config	JeVois Inventor Code C++

JeVois Inventor Code Python DNN	JeVois Inventor System

JeVois Inventor System Export SD Card	JeVois Inventor System Export SD Card Content

Being quite busy these days. Seriously, ARM board based on AllWinner H3 from my company Longer Vision is manufactured, and under test. Let’s have some fun.

In the end, better to listen to some music while blogging.

ESP32-Cam

Posted on 2019-08-22 | Edited on 2019-08-24 | In Machine Vision , MCU

0. Preface

My ESP32-Cam has finally arrived today. The brand of AI Thinker has been demonstrated to be reliable.

In fact, I strictly followed randomnerdtutorials’s blog ESP32-CAM Video Streaming and Face Recognition with Arduino IDE to demonstrate this low-cost video surveillance camera. So, in this blog, I ONLY enumerate some KEY POINTS that should be emphasized.

1. Connection

1.1 Schematic

ESP32-Cam can be connected to my laptop exactly the same as shown (cited directly from ESP32-CAM Video Streaming and Face Recognition with Arduino IDE).

ESP32-CAM-wiring-FTDI Schematic

1.2 Real Connection

The real connection looks as:

ESP32-CAM-wiring-FTDI Real Connection

1.3 lsusb

longervision-GT72-6QE% lsusb
......
Bus 001 Device 010: ID 0403:6001 Future Technology Devices International, Ltd FT232 Serial (UART) IC
......

2. Key Points on Flashing ESP32-Cam

2.1 Code Modification

Example code CameraWebServer should be trivially modified as:

// Select camera model
//#define CAMERA_MODEL_WROVER_KIT
//#define CAMERA_MODEL_ESP_EYE
//#define CAMERA_MODEL_M5STACK_PSRAM
//#define CAMERA_MODEL_M5STACK_WIDE
#define CAMERA_MODEL_AI_THINKER

2.2 Verify/Compile and Upload

2.2.1 Verify/Compile

1
2

Sketch uses 2241942 bytes (71%) of program storage space. Maximum is 3145728 bytes.
Global variables use 52696 bytes (16%) of dynamic memory, leaving 274984 bytes for local variables. Maximum is 327680 bytes.

2.2.2 Upload

esptool.py v2.6
Serial port /dev/ttyUSB0
Connecting....
Chip is ESP32D0WDQ5 (revision 1)
Features: WiFi, BT, Dual Core, 240MHz, VRef calibration in efuse, Coding Scheme None
MAC: c4:4f:33:13:32:7d
Uploading stub...
Running stub...
Stub running...
Configuring flash size...
Auto-detected Flash size: 4MB
Compressed 8192 bytes to 47...

Writing at 0x0000e000... (100 %)
Wrote 8192 bytes (47 compressed) at 0x0000e000 in 0.0 seconds (effective 4102.7 kbit/s)...
Hash of data verified.
Compressed 16832 bytes to 10888...

Writing at 0x00001000... (100 %)
Wrote 16832 bytes (10888 compressed) at 0x00001000 in 1.0 seconds (effective 138.0 kbit/s)...
Hash of data verified.
Compressed 2242064 bytes to 1795627...

Writing at 0x00010000... (0 %)
Writing at 0x00014000... (1 %)
Writing at 0x00018000... (2 %)
Writing at 0x0001c000... (3 %)
Writing at 0x00020000... (4 %)
Writing at 0x00024000... (5 %)
Writing at 0x00028000... (6 %)
Writing at 0x0002c000... (7 %)
Writing at 0x00030000... (8 %)
Writing at 0x00034000... (9 %)
Writing at 0x00038000... (10 %)
Writing at 0x0003c000... (10 %)
Writing at 0x00040000... (11 %)
Writing at 0x00044000... (12 %)
Writing at 0x00048000... (13 %)
Writing at 0x0004c000... (14 %)
Writing at 0x00050000... (15 %)
Writing at 0x00054000... (16 %)
Writing at 0x00058000... (17 %)
Writing at 0x0005c000... (18 %)
Writing at 0x00060000... (19 %)
Writing at 0x00064000... (20 %)
Writing at 0x00068000... (20 %)
Writing at 0x0006c000... (21 %)
Writing at 0x00070000... (22 %)
Writing at 0x00074000... (23 %)
Writing at 0x00078000... (24 %)
Writing at 0x0007c000... (25 %)
Writing at 0x00080000... (26 %)
Writing at 0x00084000... (27 %)
Writing at 0x00088000... (28 %)
Writing at 0x0008c000... (29 %)
Writing at 0x00090000... (30 %)
Writing at 0x00094000... (30 %)
Writing at 0x00098000... (31 %)
Writing at 0x0009c000... (32 %)
Writing at 0x000a0000... (33 %)
Writing at 0x000a4000... (34 %)
Writing at 0x000a8000... (35 %)
Writing at 0x000ac000... (36 %)
Writing at 0x000b0000... (37 %)
Writing at 0x000b4000... (38 %)
Writing at 0x000b8000... (39 %)
Writing at 0x000bc000... (40 %)
Writing at 0x000c0000... (40 %)
Writing at 0x000c4000... (41 %)
Writing at 0x000c8000... (42 %)
Writing at 0x000cc000... (43 %)
Writing at 0x000d0000... (44 %)
Writing at 0x000d4000... (45 %)
Writing at 0x000d8000... (46 %)
Writing at 0x000dc000... (47 %)
Writing at 0x000e0000... (48 %)
Writing at 0x000e4000... (49 %)
Writing at 0x000e8000... (50 %)
Writing at 0x000ec000... (50 %)
Writing at 0x000f0000... (51 %)
Writing at 0x000f4000... (52 %)
Writing at 0x000f8000... (53 %)
Writing at 0x000fc000... (54 %)
Writing at 0x00100000... (55 %)
Writing at 0x00104000... (56 %)
Writing at 0x00108000... (57 %)
Writing at 0x0010c000... (58 %)
Writing at 0x00110000... (59 %)
Writing at 0x00114000... (60 %)
Writing at 0x00118000... (60 %)
Writing at 0x0011c000... (61 %)
Writing at 0x00120000... (62 %)
Writing at 0x00124000... (63 %)
Writing at 0x00128000... (64 %)
Writing at 0x0012c000... (65 %)
Writing at 0x00130000... (66 %)
Writing at 0x00134000... (67 %)
Writing at 0x00138000... (68 %)
Writing at 0x0013c000... (69 %)
Writing at 0x00140000... (70 %)
Writing at 0x00144000... (70 %)
Writing at 0x00148000... (71 %)
Writing at 0x0014c000... (72 %)
Writing at 0x00150000... (73 %)
Writing at 0x00154000... (74 %)
Writing at 0x00158000... (75 %)
Writing at 0x0015c000... (76 %)
Writing at 0x00160000... (77 %)
Writing at 0x00164000... (78 %)
Writing at 0x00168000... (79 %)
Writing at 0x0016c000... (80 %)
Writing at 0x00170000... (80 %)
Writing at 0x00174000... (81 %)
Writing at 0x00178000... (82 %)
Writing at 0x0017c000... (83 %)
Writing at 0x00180000... (84 %)
Writing at 0x00184000... (85 %)
Writing at 0x00188000... (86 %)
Writing at 0x0018c000... (87 %)
Writing at 0x00190000... (88 %)
Writing at 0x00194000... (89 %)
Writing at 0x00198000... (90 %)
Writing at 0x0019c000... (90 %)
Writing at 0x001a0000... (91 %)
Writing at 0x001a4000... (92 %)
Writing at 0x001a8000... (93 %)
Writing at 0x001ac000... (94 %)
Writing at 0x001b0000... (95 %)
Writing at 0x001b4000... (96 %)
Writing at 0x001b8000... (97 %)
Writing at 0x001bc000... (98 %)
Writing at 0x001c0000... (99 %)
Writing at 0x001c4000... (100 %)
Wrote 2242064 bytes (1795627 compressed) at 0x00010000 in 159.6 seconds (effective 112.4 kbit/s)...
Hash of data verified.
Compressed 3072 bytes to 134...

Writing at 0x00008000... (100 %)
Wrote 3072 bytes (134 compressed) at 0x00008000 in 0.0 seconds (effective 1534.2 kbit/s)...
Hash of data verified.

Leaving...
Hard resetting via RTS pin...

2.3 Disconnect GPIO 0 from GND

Before testing the code, be sure to disconnect GPIO 0 from GND.

ESP32-CAM Disconnect

2.4 RESET ESP32-Cam Board

It’s VERY important that you open the Serial Monitor dialog to monitor the serial port. You will see the following outputs after resetting ESP32-Cam board.

ets Jun  8 2016 00:22:57

rst:0x1 (POWERON_RESET),boot:0x13 (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0xee
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
mode:DIO, clock div:1
load:0x3fff0018,len:4
load:0x3fff001c,len:1100
load:0x40078000,len:9232
load:0x40080400,len:6400
entry 0x400806a8

[E][sccb.c:154] SCCB_Write(): SCCB_Write Failed addr:0x30, reg:0xff, data:0x01, ret:-1
.........
WiFi connected
Starting web server on port: '80'
Starting stream server on port: '81'
Camera Ready! Use 'http://192.168.1.94' to connect

2.5 Video Streaming

By visiting the allocated IP address within any web browser, you’ll see the following picture:

ESP32-CAM OV2460

And you’ll notice the streaming info from serial port:

ets Jun  8 2016 00:22:57

rst:0x1 (POWERON_RESET),boot:0x13 (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0xee
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
mode:DIO, clock div:1
load:0x3fff0018,len:4
load:0x3fff001c,len:1100
load:0x40078000,len:9232
load:0x40080400,len:6400
entry 0x400806a8

[E][sccb.c:154] SCCB_Write(): SCCB_Write Failed addr:0x30, reg:0xff, data:0x01, ret:-1
.........
WiFi connected
Starting web server on port: '80'
Starting stream server on port: '81'
Camera Ready! Use 'http://192.168.1.94' to connect
MJPG: 5297B 63ms (15.9fps), AVG: 63ms (15.9fps), 0+0+0+0=0 0
MJPG: 5301B 40ms (25.0fps), AVG: 51ms (19.6fps), 0+0+0+0=0 0
MJPG: 5460B 39ms (25.6fps), AVG: 47ms (21.3fps), 0+0+0+0=0 0
MJPG: 5301B 40ms (25.0fps), AVG: 45ms (22.2fps), 0+0+0+0=0 0
MJPG: 5460B 43ms (23.3fps), AVG: 45ms (22.2fps), 0+0+0+0=0 0
MJPG: 5374B 41ms (24.4fps), AVG: 44ms (22.7fps), 0+0+0+0=0 0
MJPG: 5460B 37ms (27.0fps), AVG: 43ms (23.3fps), 0+0+0+0=0 0
MJPG: 5464B 43ms (23.3fps), AVG: 43ms (23.3fps), 0+0+0+0=0 0
MJPG: 5460B 37ms (27.0fps), AVG: 42ms (23.8fps), 0+0+0+0=0 0
MJPG: 5464B 46ms (21.7fps), AVG: 42ms (23.8fps), 0+0+0+0=0 0
MJPG: 5460B 30ms (33.3fps), AVG: 41ms (24.4fps), 0+0+0+0=0 0
MJPG: 5464B 43ms (23.3fps), AVG: 41ms (24.4fps), 0+0+0+0=0 0
MJPG: 5460B 39ms (25.6fps), AVG: 41ms (24.4fps), 0+0+0+0=0 0
MJPG: 5464B 37ms (27.0fps), AVG: 41ms (24.4fps), 0+0+0+0=0 0
MJPG: 5460B 37ms (27.0fps), AVG: 41ms (24.4fps), 0+0+0+0=0 0
......

3. Multiple Camera Streaming with Static IPs

I’m NOT going to talk about how to set up static IPs for IP cameras (well, yes, clearly, ESP32-Cam can be looked on as a low-cost video surveillance IP camera for sure). We ONLY demonstrate 4 ESP32-Cams are under streaming simultaneously with 4 statically allocated IP addresses.

We show the capturing effects FIRST:

4 ESP32-Cam Capturing Simultaneously

Then, we show how the cables are connected by using a power bank and an extra bread board. Here, FTDI is just used as a power adaptor to provide 5V voltage.

4 ESP32-Cams Connected to Power Bank

4 ESP32-Cams Cable Connection

Mourn For Classmate

Posted on 2019-08-15 | Edited on 2019-08-18 | In Personal

噩耗传来，今晨，高中同学逝世，年仅43岁。今天是2019年8月15日，是日军投降的日子。同学经历4个月急性胰腺炎的煎熬，耗光所有家财，于北京时间早上9时11分不治。这两个神奇的时间…

难忘高中一起踢球、打麻将的日子。在球场上，他是跑不死的。而且身体肌肉比较多，所以才有两个外号：“施瓦辛格”、“周扎实”。

我的印象，他应该是我们高中班第一位走的同学。人生无常，想当年，他也是我们班第一位获得保送的同学吧？老天爷就是这样不公平。1995年，湖北省是高考前先保送，但是保送了之后还要参加高考，保送者确定必须过一本线才能进入所保送的大学就读。他心态好的出奇，保送东北大学之后就不再学习了，每天看金庸小说。高考竟然考到652？不太记得分数。总之，是一个在湖北省稳稳上清华的分数。经历了本硕连读，东大阿派的锤炼，他成功完成香港中文大学博士学位，并令人羡慕的进入珠海某大学就职，面朝大海、春暖花开的海景房，曾经令我幻想羡慕不已…可惜至今，我也没有机会去看过。

他的婚礼是在武汉办的，我是亲自参加的，他娶了一位非常漂亮的嫂子。他在婚礼上非常紧张，大概是兴奋的？夫妻对拜的时候，竟然说出“感谢娶我为妻”！这个证据确凿，每每想起，忍俊不止。

我在英国的时候，他给我介绍了一个很漂亮的女朋友。可惜缘分没有让我们走到一起。我还是通过这位已经是两个孩子的妈妈，获悉同学的病情，并立即通知高中同班同学筹款。只可惜还是…听到病危病重，真的是不敢相信自己的耳朵！确定水滴筹的照片就是他本人，已经瘦得不成人形！获悉同学病情的前三天，每天早上起床，眼睛湿润都不自知…前几年我到珠海，我们几位高中同学还吃海鲜聚会，没有见到他。没想到那次错过，就错过了一世…

这几年，见得太多了！这个社会，好像真的是：越是好人，越走得早？老天爷啊…“逢庙必拜、遇观必香”…人到中年，真的开始有点相信神佛…根本还没来得及小小欢庆几小时前首次带父母到美国小游，就…明天去列治文拜佛祈福。

我很喜欢卡拉OK，一直想要在hexo blog 加入自己原唱作为背景音乐（这也算是创新吧？），今天这篇不算是祷文的blog，纪念我同学，也算督促我完成了这个小小任务。回到家、刚刚开始check wechat，就看到这个噩耗，真的是… 这是我第一次发全民K歌，中间有跑调，我觉得没有必要修改任何！因为这就是我自己原唱，在听到消息之后，也着实情绪不能控制…

人生的意义在什么？“且行且珍惜”！珍惜身边拥有的一切吧！想起去年某台姐对我说：“看到你一家三口团聚，就感觉很幸福”。是啊…台姐本人从小姥姥带大、10岁出头一个人给姥姥送葬；而周伯伯白发人送黑发人，这…人，真的不能太“不知足”！我思想还没成熟呢！这么大了，怎么长的？太幼稚！！种地，有什么不好？？

不知不觉，温哥华当地时间2019年8月15日凌晨3点20分。愿你在天堂没有痛苦…

Widora AIRV/K210 Board with ESP8266/ESP8285 Espressif Wifi and Kendryte K210 AI

Posted on 2019-08-07 | Edited on 2019-08-18 | In Single Board Computers , Risc-V

Having been keeping an eye on Widora and Espressif for quite a bit. I finally decided to test out Widora’s development board AIRV.

1. Background Knowledge

1.1 Espressif

Espressif is based in Shanghai, China, focusing on Wifi/Bluetooth chips, now have two main Wifi modules:

ESP32: Wifi with Bluetooth
ESP8266/ESP8285: Wifi ONLY

1.2 Widora

Widora is headquartered in Beijing, China, providing development boards using Espressif Wifi/Bluetooth chips.

1.3 Kendryte

NEVER heard of Kendryte before. It seems Kendryte develops some AI based on Risc-V chip architecture? That seems to be a good concept…

1.4 HiFive

As for Risc-V, HiFive developed by SiFive has to be mentioned in any case.

For me, a NOBODY has NOT had any chance or capability to deal with chips… So… shame… Anyway, let’s test it out… ^_

2. Test on Widora AIRV Face Detection

By using a RUBBISH USB cable, you should already be able to run the face detection sample code existing inside the board.

Normal	Occlusion

However, you really need to use a QUALIFIED Micro-B USB to USB Type A cable, in order to list the device out by lsusb.

1 2	➜ ~ lsusb Bus 001 Device 010: ID 10c4:ea60 Cygnal Integrated Products, Inc. CP2102/CP2109 UART Bridge Controller [CP210x family]

3. PlatformIO IDE for VSCode

PlatformIO IDE

4. Reflash Widora AIRV

SiFive HiFive1 Rev B

Posted on 2019-08-02 | Edited on 2019-08-18 | In Single Board Computers , Risc-V

Today, I got a very BAD news: one of my BEST classmates in my senior middle school has been staying in the hospital for OVER 3 months. The very serious pancreatitis has used up ALL his family’s savings. That is the current Chinese medical system. Chinese people have NO 2nd choice:

either be the ruled class, who need to pay unaffordable medical service fee
or be the ruling class, who have THE RIGHT to enjoy ALL types of FREE medical service

SiFive is a NEW birth in the CHIP industry, which is based on RISC-V, started by University of California, Berkeley. I don’t know where it will go, and how well it can do. But, innovation is just the right way to breakthrough the STALE ruling class.

1. Zephyr

There are plenty of popular RTOSes for MCUs with different architectures, including ARM, RISC-V, etc.

In my personal point of view:

MCUs: are based on microcontrollers, which are normally single user single thread.
SBCs: come with a true multi-user multi-threading operating system, for instance, Linux.

1.1 Popular RTOSes

A detailed summary can be found on Wikipedia.

1.2 Getting Started With Zephyr

Over 150 boards are NOW supported by Zephyr, including today’s leading role: HiFive1 Rev B. Let’s just test out Zephyr right away.

In the following, we strictly follow Zephyr Getting Started Guide, with trivial customization.

1.2.1 Get the source code

Make sure west has been installed by pip install -U west --user, and then initialize and update Zephyr project contents as:

➜  Zephyr pip show west
Name: west
Version: 0.6.0
Summary: Zephyr RTOS Project meta-tool
Home-page: https://github.com/zephyrproject-rtos/west
Author: Zephyr Project
Author-email: devel@lists.zephyrproject.org
License: UNKNOWN
Location: ~/.local/lib/python3.7/site-packages
Requires: PyYAML, configobj, colorama, pykwalify, setuptools
Required-by:
➜  Zephyr west init zephyrproject
=== Initializing in ....../zephyrproject
--- Cloning manifest repository from https://github.com/zephyrproject-rtos/zephyr, rev. master
Initialized empty Git repository in ....../zephyrproject/.west/manifest-tmp/.git/
remote: Enumerating objects: 7, done.
remote: Counting objects: 100% (7/7), done.
remote: Compressing objects: 100% (7/7), done.
remote: Total 359884 (delta 1), reused 0 (delta 0), pack-reused 359877
Receiving objects: 100% (359884/359884), 254.15 MiB | 12.49 MiB/s, done.
Resolving deltas: 100% (267566/267566), done.
From https://github.com/zephyrproject-rtos/zephyr
 * branch            master                         -> FETCH_HEAD
 * [new branch]      arm                            -> origin/arm
 * [new branch]      backport-14980-to-v1.14-branch -> origin/backport-14980-to-v1.14-branch
 * [new branch]      backport-15780-to-v1.14-branch -> origin/backport-15780-to-v1.14-branch
 * [new branch]      backport-17058-to-v1.14-branch -> origin/backport-17058-to-v1.14-branch
 * [new branch]      backport-17066-to-v1.14-branch -> origin/backport-17066-to-v1.14-branch
 * [new branch]      backport-17067-to-v1.14-branch -> origin/backport-17067-to-v1.14-branch
 * [new branch]      backport-17141-to-v1.14-branch -> origin/backport-17141-to-v1.14-branch
 * [new branch]      backport-17146-to-v1.14-branch -> origin/backport-17146-to-v1.14-branch
 * [new branch]      backport-17159-to-v1.14-branch -> origin/backport-17159-to-v1.14-branch
 * [new branch]      backport-17227-to-v1.14-branch -> origin/backport-17227-to-v1.14-branch
 * [new branch]      backport-17263-to-v1.14-branch -> origin/backport-17263-to-v1.14-branch
 * [new branch]      backport-17289-to-v1.14-branch -> origin/backport-17289-to-v1.14-branch
 * [new branch]      backport-17298-to-v1.14-branch -> origin/backport-17298-to-v1.14-branch
 * [new branch]      backport-17305-to-v1.14-branch -> origin/backport-17305-to-v1.14-branch
 * [new branch]      backport-17308-to-v1.14-branch -> origin/backport-17308-to-v1.14-branch
 * [new branch]      backport-17351-to-v1.14-branch -> origin/backport-17351-to-v1.14-branch
 * [new branch]      backport-17360-to-v1.14-branch -> origin/backport-17360-to-v1.14-branch
 * [new branch]      backport-17369-to-v1.14-branch -> origin/backport-17369-to-v1.14-branch
 * [new branch]      backport-17400-to-v1.14-branch -> origin/backport-17400-to-v1.14-branch
 * [new branch]      backport-17402-to-v1.14-branch -> origin/backport-17402-to-v1.14-branch
 * [new branch]      backport-17404-to-v1.14-branch -> origin/backport-17404-to-v1.14-branch
 * [new branch]      backport-17405-to-v1.14-branch -> origin/backport-17405-to-v1.14-branch
 * [new branch]      backport-17428-to-v1.14-branch -> origin/backport-17428-to-v1.14-branch
 * [new branch]      backport-17451-to-v1.14-branch -> origin/backport-17451-to-v1.14-branch
 * [new branch]      backport-17465-to-v1.14-branch -> origin/backport-17465-to-v1.14-branch
 * [new branch]      backport-17474-to-v1.14-branch -> origin/backport-17474-to-v1.14-branch
 * [new branch]      backport-17489-to-v1.14-branch -> origin/backport-17489-to-v1.14-branch
 * [new branch]      backport-17575-to-v1.14-branch -> origin/backport-17575-to-v1.14-branch
 * [new branch]      backport-17596-to-v1.14-branch -> origin/backport-17596-to-v1.14-branch
 * [new branch]      backport-17601-to-v1.14-branch -> origin/backport-17601-to-v1.14-branch
 * [new branch]      backport-17602-to-v1.14-branch -> origin/backport-17602-to-v1.14-branch
 * [new branch]      backport-17603-to-v1.14-branch -> origin/backport-17603-to-v1.14-branch
 * [new branch]      backport-17605-to-v1.14-branch -> origin/backport-17605-to-v1.14-branch
 * [new branch]      backport-17606-to-v1.14-branch -> origin/backport-17606-to-v1.14-branch
 * [new branch]      backport-17614-to-v1.14-branch -> origin/backport-17614-to-v1.14-branch
 * [new branch]      backport-17618-to-v1.14-branch -> origin/backport-17618-to-v1.14-branch
 * [new branch]      backport-17705-to-v1.14-branch -> origin/backport-17705-to-v1.14-branch
 * [new branch]      backport-17724-to-v1.14-branch -> origin/backport-17724-to-v1.14-branch
 * [new branch]      backport-17798-to-v1.14-branch -> origin/backport-17798-to-v1.14-branch
 * [new branch]      backport-17836-to-v1.14-branch -> origin/backport-17836-to-v1.14-branch
 * [new branch]      backport-17859-to-v1.14-branch -> origin/backport-17859-to-v1.14-branch
 * [new branch]      master                         -> origin/master
 * [new branch]      pull/17988/head                -> origin/pull/17988/head
 * [new branch]      topic-EDTS                     -> origin/topic-EDTS
 * [new branch]      topic-sensors                  -> origin/topic-sensors
 * [new branch]      v1.10-branch                   -> origin/v1.10-branch
 * [new branch]      v1.11-branch                   -> origin/v1.11-branch
 * [new branch]      v1.12-branch                   -> origin/v1.12-branch
 * [new branch]      v1.13-branch                   -> origin/v1.13-branch
 * [new branch]      v1.14-branch                   -> origin/v1.14-branch
 * [new branch]      v1.5-branch                    -> origin/v1.5-branch
 * [new branch]      v1.6-branch                    -> origin/v1.6-branch
 * [new branch]      v1.7-branch                    -> origin/v1.7-branch
 * [new branch]      v1.8-branch                    -> origin/v1.8-branch
 * [new branch]      v1.9-branch                    -> origin/v1.9-branch
 * [new tag]         v1.0.0                         -> v1.0.0
 * [new tag]         v1.1.0                         -> v1.1.0
 * [new tag]         v1.1.0-rc1                     -> v1.1.0-rc1
 * [new tag]         v1.10.0                        -> v1.10.0
 * [new tag]         v1.10.0-rc1                    -> v1.10.0-rc1
 * [new tag]         v1.10.0-rc2                    -> v1.10.0-rc2
 * [new tag]         v1.10.0-rc3                    -> v1.10.0-rc3
 * [new tag]         v1.11.0                        -> v1.11.0
 * [new tag]         v1.11.0-rc1                    -> v1.11.0-rc1
 * [new tag]         v1.11.0-rc2                    -> v1.11.0-rc2
 * [new tag]         v1.11.0-rc3                    -> v1.11.0-rc3
 * [new tag]         v1.12.0                        -> v1.12.0
 * [new tag]         v1.12.0-rc1                    -> v1.12.0-rc1
 * [new tag]         v1.12.0-rc2                    -> v1.12.0-rc2
 * [new tag]         v1.12.0-rc3                    -> v1.12.0-rc3
 * [new tag]         v1.13.0                        -> v1.13.0
 * [new tag]         v1.13.0-rc1                    -> v1.13.0-rc1
 * [new tag]         v1.13.0-rc2                    -> v1.13.0-rc2
 * [new tag]         v1.13.0-rc3                    -> v1.13.0-rc3
 * [new tag]         v1.14.0                        -> v1.14.0
 * [new tag]         v1.14.0-rc1                    -> v1.14.0-rc1
 * [new tag]         v1.14.0-rc2                    -> v1.14.0-rc2
 * [new tag]         v1.14.0-rc3                    -> v1.14.0-rc3
 * [new tag]         v1.14.1-rc1                    -> v1.14.1-rc1
 * [new tag]         v1.2.0                         -> v1.2.0
 * [new tag]         v1.2.0-rc1                     -> v1.2.0-rc1
 * [new tag]         v1.2.0-rc2                     -> v1.2.0-rc2
 * [new tag]         v1.3.0                         -> v1.3.0
 * [new tag]         v1.3.0-rc1                     -> v1.3.0-rc1
 * [new tag]         v1.3.0-rc2                     -> v1.3.0-rc2
 * [new tag]         v1.4.0                         -> v1.4.0
 * [new tag]         v1.4.0-rc1                     -> v1.4.0-rc1
 * [new tag]         v1.4.0-rc2                     -> v1.4.0-rc2
 * [new tag]         v1.4.0-rc3                     -> v1.4.0-rc3
 * [new tag]         v1.5.0                         -> v1.5.0
 * [new tag]         v1.5.0-rc0                     -> v1.5.0-rc0
 * [new tag]         v1.5.0-rc1                     -> v1.5.0-rc1
 * [new tag]         v1.5.0-rc2                     -> v1.5.0-rc2
 * [new tag]         v1.5.0-rc3                     -> v1.5.0-rc3
 * [new tag]         v1.5.0-rc4                     -> v1.5.0-rc4
 * [new tag]         v1.6.0                         -> v1.6.0
 * [new tag]         v1.6.0-rc1                     -> v1.6.0-rc1
 * [new tag]         v1.6.0-rc2                     -> v1.6.0-rc2
 * [new tag]         v1.6.0-rc3                     -> v1.6.0-rc3
 * [new tag]         v1.6.0-rc4                     -> v1.6.0-rc4
 * [new tag]         v1.6.1                         -> v1.6.1
 * [new tag]         v1.6.1-rc                      -> v1.6.1-rc
 * [new tag]         v1.6.99                        -> v1.6.99
 * [new tag]         v1.7.0                         -> v1.7.0
 * [new tag]         v1.7.0-rc1                     -> v1.7.0-rc1
 * [new tag]         v1.7.0-rc2                     -> v1.7.0-rc2
 * [new tag]         v1.7.0-rc3                     -> v1.7.0-rc3
 * [new tag]         v1.7.0-rc4                     -> v1.7.0-rc4
 * [new tag]         v1.7.1                         -> v1.7.1
 * [new tag]         v1.7.1-rc                      -> v1.7.1-rc
 * [new tag]         v1.7.99                        -> v1.7.99
 * [new tag]         v1.8.0                         -> v1.8.0
 * [new tag]         v1.8.0-rc1                     -> v1.8.0-rc1
 * [new tag]         v1.8.0-rc2                     -> v1.8.0-rc2
 * [new tag]         v1.8.0-rc3                     -> v1.8.0-rc3
 * [new tag]         v1.8.0-rc4                     -> v1.8.0-rc4
 * [new tag]         v1.8.99                        -> v1.8.99
 * [new tag]         v1.9.0                         -> v1.9.0
 * [new tag]         v1.9.0-rc1                     -> v1.9.0-rc1
 * [new tag]         v1.9.0-rc2                     -> v1.9.0-rc2
 * [new tag]         v1.9.0-rc3                     -> v1.9.0-rc3
 * [new tag]         v1.9.0-rc4                     -> v1.9.0-rc4
 * [new tag]         v1.9.1                         -> v1.9.1
 * [new tag]         v1.9.2                         -> v1.9.2
 * [new tag]         zephyr-v1.0.0                  -> zephyr-v1.0.0
 * [new tag]         zephyr-v1.1.0                  -> zephyr-v1.1.0
 * [new tag]         zephyr-v1.10.0                 -> zephyr-v1.10.0
 * [new tag]         zephyr-v1.11.0                 -> zephyr-v1.11.0
 * [new tag]         zephyr-v1.12.0                 -> zephyr-v1.12.0
 * [new tag]         zephyr-v1.13.0                 -> zephyr-v1.13.0
 * [new tag]         zephyr-v1.14.0                 -> zephyr-v1.14.0
 * [new tag]         zephyr-v1.2.0                  -> zephyr-v1.2.0
 * [new tag]         zephyr-v1.3.0                  -> zephyr-v1.3.0
 * [new tag]         zephyr-v1.4.0                  -> zephyr-v1.4.0
 * [new tag]         zephyr-v1.5.0                  -> zephyr-v1.5.0
 * [new tag]         zephyr-v1.6.0                  -> zephyr-v1.6.0
 * [new tag]         zephyr-v1.6.1                  -> zephyr-v1.6.1
 * [new tag]         zephyr-v1.7.0                  -> zephyr-v1.7.0
 * [new tag]         zephyr-v1.7.1                  -> zephyr-v1.7.1
 * [new tag]         zephyr-v1.8.0                  -> zephyr-v1.8.0
 * [new tag]         zephyr-v1.9.0                  -> zephyr-v1.9.0
 * [new tag]         zephyr-v1.9.1                  -> zephyr-v1.9.1
 * [new tag]         zephyr-v1.9.2                  -> zephyr-v1.9.2
77db273f6f84b3d94d34b5e72070ec6bc31e41cf refs/remotes/origin/master
Checking out files: 100% (11758/11758), done.
Branch 'master' set up to track remote branch 'master' from 'origin'.
Already on 'master'
=== Initialized. Now run "west update" inside ....../zephyrproject.
➜  Zephyr cd zephyrproject
➜  zephyrproject west update
=== updating ci-tools (tools/ci-tools):
--- ci-tools: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/tools/ci-tools/.git/
--- ci-tools: fetching changes
remote: Enumerating objects: 40, done.
remote: Counting objects: 100% (40/40), done.
remote: Compressing objects: 100% (37/37), done.
remote: Total 396 (delta 27), reused 15 (delta 3), pack-reused 356
Receiving objects: 100% (396/396), 114.12 KiB | 990.00 KiB/s, done.
Resolving deltas: 100% (259/259), done.
From https://github.com/zephyrproject-rtos/ci-tools
 * [new branch]      cc-crlf      -> refs/west/cc-crlf
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
 * [new branch]      whatchanged  -> refs/west/whatchanged
HEAD is now at d56f2dd compliance: clarify CODEOWNER message
--- ci-tools: checked out d56f2dd3510e20fa8cf4aad442495c08a658113f as detached HEAD
=== updating civetweb (modules/lib/civetweb):
--- civetweb: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/lib/civetweb/.git/
--- civetweb: fetching changes
remote: Enumerating objects: 112, done.
remote: Counting objects: 100% (112/112), done.
remote: Compressing objects: 100% (72/72), done.
remote: Total 21202 (delta 57), reused 81 (delta 37), pack-reused 21090
Receiving objects: 100% (21202/21202), 24.50 MiB | 21.95 MiB/s, done.
Resolving deltas: 100% (13585/13585), done.
From https://github.com/antmicro/civetweb
 * [new branch]      1.9                       -> refs/west/1.9
 * [new branch]      array_size_check          -> refs/west/array_size_check
 * [new branch]      initial-dirty-zephyr-port -> refs/west/initial-dirty-zephyr-port
 * [new branch]      master                    -> refs/west/master
 * [new branch]      no-filesystems            -> refs/west/no-filesystems
 * [new branch]      no-filesystems-fixes      -> refs/west/no-filesystems-fixes
 * [new branch]      no-filesystems-follow-up  -> refs/west/no-filesystems-follow-up
 * [new branch]      no-filesytems-followup    -> refs/west/no-filesytems-followup
 * [new branch]      wip-ssl-error-queue       -> refs/west/wip-ssl-error-queue
 * [new branch]      wip-zephyr-port           -> refs/west/wip-zephyr-port
 * [new branch]      zephyr-buildsystem-fix    -> refs/west/zephyr-buildsystem-fix
 * [new branch]      zephyr-rtos-port          -> refs/west/zephyr-rtos-port
 * [new branch]      zephyr-sample             -> refs/west/zephyr-sample
 * [new tag]         v1.1                      -> v1.1
 * [new tag]         v1.10                     -> v1.10
 * [new tag]         v1.11                     -> v1.11
 * [new tag]         v1.2                      -> v1.2
 * [new tag]         v1.3                      -> v1.3
 * [new tag]         v1.4                      -> v1.4
 * [new tag]         v1.5                      -> v1.5
 * [new tag]         v1.6                      -> v1.6
 * [new tag]         v1.7                      -> v1.7
 * [new tag]         v1.8                      -> v1.8
 * [new tag]         v1.9                      -> v1.9
 * [new tag]         v1.9.1                    -> v1.9.1
HEAD is now at 7ffad765 Merge pull request #773 from antmicro/zephyr-buildsystem-fix
--- civetweb: checked out 7ffad765f9a63a7bab3432ca45248981f559d559 as detached HEAD
=== updating esp-idf (modules/hal/esp-idf):
--- esp-idf: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/hal/esp-idf/.git/
--- esp-idf: fetching changes
remote: Enumerating objects: 76449, done.
remote: Counting objects: 100% (76449/76449), done.
remote: Compressing objects: 100% (19840/19840), done.
remote: Total 76449 (delta 54455), reused 76449 (delta 54455), pack-reused 0
Receiving objects: 100% (76449/76449), 69.09 MiB | 24.97 MiB/s, done.
Resolving deltas: 100% (54455/54455), done.
From https://github.com/zephyrproject-rtos/esp-idf
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
 * [new branch]      zephyr       -> refs/west/zephyr
HEAD is now at 6835bfc74 module: add zephyr integration
--- esp-idf: checked out 6835bfc741bf15e98fb7971293913f770df6081f as detached HEAD
=== updating fatfs (modules/fs/fatfs):
--- fatfs: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/fs/fatfs/.git/
--- fatfs: fetching changes
remote: Enumerating objects: 92, done.
remote: Counting objects: 100% (92/92), done.
remote: Compressing objects: 100% (45/45), done.
remote: Total 92 (delta 45), reused 92 (delta 45), pack-reused 0
Unpacking objects: 100% (92/92), done.
From https://github.com/zephyrproject-rtos/fatfs
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
HEAD is now at df96914 zephyr: add fatfs as a module
--- fatfs: checked out df96914dd989907f3a5de4cb95b116c2f305820d as detached HEAD
=== updating hal_qmsi (modules/hal/qmsi):
--- hal_qmsi: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/hal/qmsi/.git/
--- hal_qmsi: fetching changes
remote: Enumerating objects: 803, done.
remote: Counting objects: 100% (803/803), done.
remote: Compressing objects: 100% (253/253), done.
remote: Total 803 (delta 490), reused 800 (delta 488), pack-reused 0
Receiving objects: 100% (803/803), 517.11 KiB | 1.78 MiB/s, done.
Resolving deltas: 100% (490/490), done.
From https://github.com/zephyrproject-rtos/hal_qmsi
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
HEAD is now at 9195fe6 zephyr: remove kconfig from module
--- hal_qmsi: checked out 9195fe6f97e4f7f25a3fc9e5a515f1b7af13762c as detached HEAD
=== updating hal_cypress (modules/hal/cypress):
--- hal_cypress: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/hal/cypress/.git/
--- hal_cypress: fetching changes
remote: Enumerating objects: 305, done.
remote: Counting objects: 100% (305/305), done.
remote: Compressing objects: 100% (198/198), done.
remote: Total 305 (delta 97), reused 305 (delta 97), pack-reused 0
Receiving objects: 100% (305/305), 954.91 KiB | 2.44 MiB/s, done.
Resolving deltas: 100% (97/97), done.
From https://github.com/zephyrproject-rtos/hal_cypress
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
HEAD is now at a12d928 zephyr: move kconfig to the zephyr tree
--- hal_cypress: checked out a12d92816a53a521d79cefcf5c38b9dc8a4fed6e as detached HEAD
=== updating hal_silabs (modules/hal/silabs):
--- hal_silabs: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/hal/silabs/.git/
--- hal_silabs: fetching changes
remote: Enumerating objects: 1175, done.
remote: Counting objects: 100% (1175/1175), done.
remote: Compressing objects: 100% (299/299), done.
remote: Total 1175 (delta 857), reused 1175 (delta 857), pack-reused 0
Receiving objects: 100% (1175/1175), 3.33 MiB | 6.52 MiB/s, done.
Resolving deltas: 100% (857/857), done.
From https://github.com/zephyrproject-rtos/hal_silabs
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
HEAD is now at 9151e61 zephyr: move kconfig to the zephyr tree
--- hal_silabs: checked out 9151e614c23997074acd1096a3e8a9e5c255d5b9 as detached HEAD
=== updating hal_st (modules/hal/st):
--- hal_st: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/hal/st/.git/
--- hal_st: fetching changes
remote: Enumerating objects: 7103, done.
remote: Counting objects: 100% (7103/7103), done.
remote: Compressing objects: 100% (1018/1018), done.
remote: Total 7103 (delta 5953), reused 7094 (delta 5946), pack-reused 0
Receiving objects: 100% (7103/7103), 22.25 MiB | 15.60 MiB/s, done.
Resolving deltas: 100% (5953/5953), done.
From https://github.com/zephyrproject-rtos/hal_st
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
HEAD is now at 0ec40ae sensor/stmemsc: Introduce STMEMS Standard C Drivers
--- hal_st: checked out 0ec40aed8087f26bd9ac1b70fb5a6c326a6451aa as detached HEAD
=== updating hal_stm32 (modules/hal/stm32):
--- hal_stm32: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/hal/stm32/.git/
--- hal_stm32: fetching changes
remote: Enumerating objects: 44, done.
remote: Counting objects: 100% (44/44), done.
remote: Compressing objects: 100% (37/37), done.
remote: Total 9226 (delta 15), reused 26 (delta 6), pack-reused 9182
Receiving objects: 100% (9226/9226), 29.54 MiB | 20.52 MiB/s, done.
Resolving deltas: 100% (7787/7787), done.
From https://github.com/zephyrproject-rtos/hal_stm32
 * [new branch]      fix_l4_can -> refs/west/fix_l4_can
 * [new branch]      master     -> refs/west/master
HEAD is now at 49c2685 stm32mp1: add i2c ll driver
--- hal_stm32: checked out 49c26855a651087578b79707fae4ddbb1c0b207d as detached HEAD
=== updating libmetal (modules/hal/libmetal):
--- libmetal: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/hal/libmetal/.git/
--- libmetal: fetching changes
remote: Enumerating objects: 412, done.
remote: Counting objects: 100% (412/412), done.
remote: Compressing objects: 100% (208/208), done.
remote: Total 412 (delta 200), reused 412 (delta 200), pack-reused 0
Receiving objects: 100% (412/412), 143.22 KiB | 971.00 KiB/s, done.
Resolving deltas: 100% (200/200), done.
From https://github.com/zephyrproject-rtos/libmetal
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
HEAD is now at 45e630d zephyr: move kconfig to the zephyr tree
--- libmetal: checked out 45e630d6152824f807d3f919958605c4626cbdff as detached HEAD
=== updating lvgl (modules/lib/gui/lvgl):
--- lvgl: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/lib/gui/lvgl/.git/
--- lvgl: fetching changes
remote: Enumerating objects: 21, done.
remote: Counting objects: 100% (21/21), done.
remote: Compressing objects: 100% (15/15), done.
remote: Total 19509 (delta 5), reused 15 (delta 4), pack-reused 19488
Receiving objects: 100% (19509/19509), 14.28 MiB | 16.21 MiB/s, done.
Resolving deltas: 100% (15472/15472), done.
From https://github.com/zephyrproject-rtos/lvgl
 * [new branch]      master     -> refs/west/master
 * [new branch]      zephyr     -> refs/west/zephyr
HEAD is now at a4626e82 lv_canvas: fix with LV_COLOR_16_SWAP
--- lvgl: checked out a4626e82781aecec137250f56d79961ca2f50b7b as detached HEAD
=== updating mbedtls (modules/crypto/mbedtls):
--- mbedtls: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/crypto/mbedtls/.git/
--- mbedtls: fetching changes
remote: Enumerating objects: 1029, done.
remote: Counting objects: 100% (1029/1029), done.
remote: Compressing objects: 100% (249/249), done.
remote: Total 1029 (delta 767), reused 1024 (delta 762), pack-reused 0
Receiving objects: 100% (1029/1029), 1.14 MiB | 3.30 MiB/s, done.
Resolving deltas: 100% (767/767), done.
From https://github.com/zephyrproject-rtos/mbedtls
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
HEAD is now at ca32746 kconfig: move to main tree
--- mbedtls: checked out ca32746072ce3381f1c9ae46ba6cd34c69f8c0ee as detached HEAD
=== updating mcumgr (modules/lib/mcumgr):
--- mcumgr: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/lib/mcumgr/.git/
--- mcumgr: fetching changes
remote: Enumerating objects: 271, done.
remote: Counting objects: 100% (271/271), done.
remote: Compressing objects: 100% (94/94), done.
remote: Total 271 (delta 129), reused 268 (delta 127), pack-reused 0
Receiving objects: 100% (271/271), 74.20 KiB | 1.03 MiB/s, done.
Resolving deltas: 100% (129/129), done.
From https://github.com/zephyrproject-rtos/mcumgr
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
HEAD is now at 8493495 kconfig: move Kconfig to main tree
--- mcumgr: checked out 84934959d2d1722a23b7e7e200191ae4a6f96168 as detached HEAD
=== updating net-tools (tools/net-tools):
--- net-tools: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/tools/net-tools/.git/
--- net-tools: fetching changes
remote: Enumerating objects: 5, done.
remote: Counting objects: 100% (5/5), done.
remote: Compressing objects: 100% (4/4), done.
remote: Total 1341 (delta 1), reused 2 (delta 1), pack-reused 1336
Receiving objects: 100% (1341/1341), 2.56 MiB | 5.37 MiB/s, done.
Resolving deltas: 100% (445/445), done.
From https://github.com/zephyrproject-rtos/net-tools
 * [new branch]      master     -> refs/west/master
HEAD is now at 30b7efa net-setup: zeth-vlan.conf: Add IP addresses to zeth
--- net-tools: checked out 30b7efa827b04d2e47840716b0372737fe7d6c92 as detached HEAD
=== updating nffs (modules/fs/nffs):
--- nffs: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/fs/nffs/.git/
--- nffs: fetching changes
remote: Enumerating objects: 62, done.
remote: Counting objects: 100% (62/62), done.
remote: Compressing objects: 100% (40/40), done.
remote: Total 62 (delta 19), reused 61 (delta 18), pack-reused 0
Unpacking objects: 100% (62/62), done.
From https://github.com/zephyrproject-rtos/nffs
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
HEAD is now at bc62a2f zephyr: add as a zephyr module
--- nffs: checked out bc62a2fa9d98ddb5d633c932ea199bc68e10f194 as detached HEAD
=== updating open-amp (modules/lib/open-amp):
--- open-amp: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/lib/open-amp/.git/
--- open-amp: fetching changes
remote: Enumerating objects: 204, done.
remote: Counting objects: 100% (204/204), done.
remote: Compressing objects: 100% (139/139), done.
remote: Total 204 (delta 57), reused 200 (delta 54), pack-reused 0
Receiving objects: 100% (204/204), 1.44 MiB | 3.89 MiB/s, done.
Resolving deltas: 100% (57/57), done.
From https://github.com/zephyrproject-rtos/open-amp
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
HEAD is now at 9b591b2 cmake: fix zephyr library abstraction violation
--- open-amp: checked out 9b591b289e1f37339bd038b5a1f0e6c8ad39c63a as detached HEAD
=== updating openthread (modules/lib/openthread):
--- openthread: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/lib/openthread/.git/
--- openthread: fetching changes
remote: Enumerating objects: 5810, done.
remote: Counting objects: 100% (5810/5810), done.
remote: Compressing objects: 100% (2007/2007), done.
remote: Total 48001 (delta 4409), reused 4649 (delta 3782), pack-reused 42191
Receiving objects: 100% (48001/48001), 59.56 MiB | 24.88 MiB/s, done.
Resolving deltas: 100% (36241/36241), done.
From https://github.com/zephyrproject-rtos/openthread
 * [new branch]      master     -> refs/west/master
 * [new branch]      zephyr     -> refs/west/zephyr
HEAD is now at 0dbecf50 west: add zephyr module
--- openthread: checked out 0dbecf508e7a79aae8ed9631f1a63fc65478b213 as detached HEAD
=== updating segger (modules/debug/segger):
--- segger: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/debug/segger/.git/
--- segger: fetching changes
remote: Enumerating objects: 140, done.
remote: Counting objects: 100% (140/140), done.
remote: Compressing objects: 100% (68/68), done.
remote: Total 140 (delta 69), reused 140 (delta 69), pack-reused 0
Receiving objects: 100% (140/140), 73.45 KiB | 529.00 KiB/s, done.
Resolving deltas: 100% (69/69), done.
From https://github.com/zephyrproject-rtos/segger
 * [new branch]      master       -> refs/west/master
 * [new branch]      v1.14-branch -> refs/west/v1.14-branch
HEAD is now at 6fcf616 ext: segger: update to SystemView v2.52h
--- segger: checked out 6fcf61606d6012d2c44129edc033f59331e268bc as detached HEAD
=== updating tinycbor (modules/lib/tinycbor):
--- tinycbor: cloning and initializing
Initialized empty Git repository in ....../zephyrproject/modules/lib/tinycbor/.git/
--- tinycbor: fetching changes
remote: Enumerating objects: 4, done.
remote: Counting objects: 100% (4/4), done.
remote: Compressing objects: 100% (2/2), done.
remote: Total 1729 (delta 0), reused 2 (delta 0), pack-reused 1725
Receiving objects: 100% (1729/1729), 1.11 MiB | 2.90 MiB/s, done.
Resolving deltas: 100% (1086/1086), done.
From https://github.com/zephyrproject-rtos/tinycbor
 * [new branch]      dev        -> refs/west/dev
 * [new branch]      gh-pages   -> refs/west/gh-pages
 * [new branch]      master     -> refs/west/master
 * [new branch]      zephyr     -> refs/west/zephyr
 * [new tag]         v0.1       -> v0.1
 * [new tag]         v0.2       -> v0.2
 * [new tag]         v0.2.1     -> v0.2.1
 * [new tag]         v0.3       -> v0.3
 * [new tag]         v0.3.1     -> v0.3.1
 * [new tag]         v0.3.2     -> v0.3.2
 * [new tag]         v0.4       -> v0.4
 * [new tag]         v0.4.1     -> v0.4.1
 * [new tag]         v0.4.2     -> v0.4.2
 * [new tag]         v0.5-beta1 -> v0.5-beta1
 * [new tag]         v0.5.0     -> v0.5.0
HEAD is now at 31ae89e zephyr: remove kconfig from module
--- tinycbor: checked out 31ae89e4b768612722620cb6cb173a0de4a19cc9 as detached HEAD
➜  zephyrproject

1.2.2 Update All Required Python Packages

Then, we manually modify/update the file ./zephyr/scripts/requirements.txt as:

wheel>=0.30.0
breathe>=4.9.1
sphinx>=1.7.5
docutils>=0.14
sphinx_rtd_theme
sphinxcontrib-svg2pdfconverter
junit2html
PyYAML>=3.13
ply>=3.10
hub>=2.0
gitlint
pyelftools>=0.24
pyocd>=0.21.0
pyserial
pykwalify
# "win32" is used for 64-bit Windows as well
# windows-curses; sys_platform == "win32"
colorama
Pillow
intelhex
pytest
gcovr

Make sure all required python packages have been installed by command:

1	➜ zephyrproject pip3 install --user -r zephyr/scripts/requirements.txt

1.2.3 Install the Zephyr Software Development Kit (Zephyr SDK)

Step 1: Download the latest Zephyr Software Development Kit

You can either directly download the latest package from Zephyr project Downloads, or get the package by the following command:

➜  zephyrproject cd..
➜  Zephyr
➜  Zephyr mkdir release
➜  Zephyr cd release
➜  release wget https://github.com/zephyrproject-rtos/sdk-ng/releases/download/v0.10.1/zephyr-sdk-0.10.1-setup.run

Step 2: Installation of Zephyr SDK

➜  release chmod +x zephyr-sdk-0.10.1-setup.run
➜  release ./zephyr-sdk-0.10.1-setup.run
Verifying archive integrity... All good.
Uncompressing SDK for Zephyr  100%  
Enter target directory for SDK (default: /opt/zephyr-sdk/): 
Installing SDK to /opt/zephyr-sdk
Creating directory /opt/zephyr-sdk
Success
 [*] Installing x86 tools... 
 [*] Installing arm tools... 
 [*] Installing arc tools... 
 [*] Installing iamcu tools... 
 [*] Installing mips tools... 
 [*] Installing nios2 tools... 
 [*] Installing xtensa tools... 
 [*] Installing riscv32 tools... 
 [*] Installing x86_64 tools... 
 [*] Installing additional host tools... 
Success installing SDK. SDK is ready to be used.

Step 3: Set Up Toolchain For RISC-V

Using Zephyr’s own toolchain is strongly recommended for Zephyr projects (refer to Zephyr Project’s Official Documentation ).

➜  release export ZEPHYR_TOOLCHAIN_VARIANT=zephyr
➜  release export ZEPHYR_SDK_INSTALL_DIR=/opt/zephyr-sdk
➜  release cd ../zephyrproject
➜  zephyrproject

1.2.4 Build and Run an Application

Before building and run an application, please make sure you have all required tools ALREADY installed on the host computer. On my HOST Ubuntu 19.04, I’ve got to manually install dtc (the latest release is version 1.5.0). I’m NOT going to talk about how go figure out installing any REQUIRED packages at this moment. Supposing you’ve got ALL REQUIRED tools successfully installed ALREADY.

➜  zephyrproject cd zephyr 
➜  zephyr git:(master) ✗ source zephyr-env.sh 
➜  zephyr git:(master) ✗ west build -b hifive1_revb samples/hello_world
-- west build: build configuration:
       source directory: ....../zephyrproject/zephyr/samples/hello_world
       build directory: ....../zephyrproject/zephyr/build
       BOARD: hifive1_revb (origin: command line)
-- west build: generating a build system
Zephyr version: 1.14.99
-- Found PythonInterp: /usr/bin/python (found suitable version "3.7.3", minimum required is "3.4") 
-- Selected BOARD hifive1_revb
-- Found west: ~/.local/bin/west (found suitable version "0.6.0", minimum required is "0.5.6")
-- Loading ....../zephyrproject/zephyr/boards/riscv/hifive1_revb/hifive1_revb.dts as base
-- Overlaying ....../zephyrproject/zephyr/dts/common/common.dts
Device tree configuration written to ....../zephyrproject/zephyr/build/zephyr/include/generated/generated_dts_board.conf
Parsing Kconfig tree in ....../zephyrproject/zephyr/Kconfig
Loaded configuration '....../zephyrproject/zephyr/boards/riscv/hifive1_revb/hifive1_revb_defconfig'
Merged configuration '....../zephyrproject/zephyr/samples/hello_world/prj.conf'
Configuration saved to '....../zephyrproject/zephyr/build/zephyr/.config'
-- Cache files will be written to: ~/.cache/zephyr
-- The C compiler identification is GNU 8.3.0
-- The CXX compiler identification is GNU 8.3.0
-- The ASM compiler identification is GNU
-- Found assembler: /opt/zephyr-sdk/riscv32-zephyr-elf/bin/riscv32-zephyr-elf-gcc
-- Performing Test toolchain_is_ok
-- Performing Test toolchain_is_ok - Success
Including module: civetweb in path: ....../zephyrproject/modules/lib/civetweb
-- Target architecture - riscv32
-- Enabling tests in the build - ON
-- Thread Stack Size - 102400
-- Enabling server executable - ON
-- Serve no static files - OFF
-- Disable CGI support - OFF
-- Disable caching support - OFF
-- C++ wrappers - OFF
-- IP Version 6 - OFF
-- Websockets support - OFF
-- Server statistics support - OFF
-- Memory Debugging - OFF
-- ASAN in debug mode - ON
-- Force x32 / x64 architecture - OFF
-- Lua CGI support - OFF
-- Executable installation - ON
-- Build if there are warnings - ON
-- Duktape CGI support - OFF
-- SSL support - ON
-- Compile for OpenSSL 1.1 API - OFF
-- Dynamically load SSL libraries - ON
-- Configuring C Compiler
-- Performing Test HAVE_C_FLAG_STD_C11
-- Performing Test HAVE_C_FLAG_STD_C11 - Success
-- Performing Test HAVE_C_FLAG_FSANITIZE_UNDEFINED
-- Performing Test HAVE_C_FLAG_FSANITIZE_UNDEFINED - Failed
-- Performing Test HAVE_C_FLAG_FSANITIZE_ADDRESS
-- Performing Test HAVE_C_FLAG_FSANITIZE_ADDRESS - Failed
-- Performing Test HAVE_C_FLAG_COVERAGE
-- Performing Test HAVE_C_FLAG_COVERAGE - Success
Including module: esp-idf in path: ....../zephyrproject/modules/hal/esp-idf/zephyr
Including module: fatfs in path: ....../zephyrproject/modules/fs/fatfs
Including module: qmsi in path: ....../zephyrproject/modules/hal/qmsi
Including module: cypress in path: ....../zephyrproject/modules/hal/cypress
Including module: silabs in path: ....../zephyrproject/modules/hal/silabs
Including module: st in path: ....../zephyrproject/modules/hal/st
Including module: stm32 in path: ....../zephyrproject/modules/hal/stm32
Including module: libmetal in path: ....../zephyrproject/modules/hal/libmetal
Including module: lvgl in path: ....../zephyrproject/modules/lib/gui/lvgl
Including module: mbedtls in path: ....../zephyrproject/modules/crypto/mbedtls
Including module: mcumgr in path: ....../zephyrproject/modules/lib/mcumgr
Including module: nffs in path: ....../zephyrproject/modules/fs/nffs
Including module: open-amp in path: ....../zephyrproject/modules/lib/open-amp
Including module: openthread in path: ....../zephyrproject/modules/lib/openthread
Including module: segger in path: ....../zephyrproject/modules/debug/segger
Including module: tinycbor in path: ....../zephyrproject/modules/lib/tinycbor
-- Configuring done
-- Generating done
-- Build files have been written to: ....../zephyrproject/zephyr/build
-- west build: building application
[0/1] Re-running CMake...
Zephyr version: 1.14.99
-- Selected BOARD hifive1_revb
-- Found west: ~/.local/bin/west (found suitable version "0.6.0", minimum required is "0.5.6")
/usr/bin/dtc
-- Loading ....../zephyrproject/zephyr/boards/riscv/hifive1_revb/hifive1_revb.dts as base
-- Overlaying ....../zephyrproject/zephyr/dts/common/common.dts
Device tree configuration written to ....../zephyrproject/zephyr/build/zephyr/include/generated/generated_dts_board.conf
Parsing Kconfig tree in ....../zephyrproject/zephyr/Kconfig
Loaded configuration '....../zephyrproject/zephyr/build/zephyr/.config'
No change to '....../zephyrproject/zephyr/build/zephyr/.config'
-- Cache files will be written to: ~/.cache/zephyr
Including module: civetweb in path: ....../zephyrproject/modules/lib/civetweb
-- Target architecture - riscv32
-- Enabling tests in the build - ON
-- Thread Stack Size - 102400
-- Enabling server executable - ON
-- Serve no static files - OFF
-- Disable CGI support - OFF
-- Disable caching support - OFF
-- C++ wrappers - OFF
-- IP Version 6 - OFF
-- Websockets support - OFF
-- Server statistics support - OFF
-- Memory Debugging - OFF
-- ASAN in debug mode - ON
-- Force x32 / x64 architecture - OFF
-- Lua CGI support - OFF
-- Executable installation - ON
-- Build if there are warnings - ON
-- Duktape CGI support - OFF
-- SSL support - ON
-- Compile for OpenSSL 1.1 API - OFF
-- Dynamically load SSL libraries - ON
-- Configuring C Compiler
Including module: esp-idf in path: ....../zephyrproject/modules/hal/esp-idf/zephyr
Including module: fatfs in path: ....../zephyrproject/modules/fs/fatfs
Including module: qmsi in path: ....../zephyrproject/modules/hal/qmsi
Including module: cypress in path: ....../zephyrproject/modules/hal/cypress
Including module: silabs in path: ....../zephyrproject/modules/hal/silabs
Including module: st in path: ....../zephyrproject/modules/hal/st
Including module: stm32 in path: ....../zephyrproject/modules/hal/stm32
Including module: libmetal in path: ....../zephyrproject/modules/hal/libmetal
Including module: lvgl in path: ....../zephyrproject/modules/lib/gui/lvgl
Including module: mbedtls in path: ....../zephyrproject/modules/crypto/mbedtls
Including module: mcumgr in path: ....../zephyrproject/modules/lib/mcumgr
Including module: nffs in path: ....../zephyrproject/modules/fs/nffs
Including module: open-amp in path: ....../zephyrproject/modules/lib/open-amp
Including module: openthread in path: ....../zephyrproject/modules/lib/openthread
Including module: segger in path: ....../zephyrproject/modules/debug/segger
Including module: tinycbor in path: ....../zephyrproject/modules/lib/tinycbor
-- Configuring done
-- Generating done
-- Build files have been written to: ....../zephyrproject/zephyr/build
[95/100] Linking C executable zephyr/zephyr_prebuilt.elf
Memory region         Used Size  Region Size  %age Used
             ROM:       15836 B      3842 KB      0.40%
             RAM:        4064 B        16 KB     24.80%
        IDT_LIST:         553 B         2 KB     27.00%
[100/100] Linking C executable zephyr/zephyr.elf

And during the building process while you run west build -b hifive1_revb samples/hello_world, you may meet the following headache issues:

➜  zephyr git:(master) ✗ west build -b hifive1_revb samples/hello_world
-- west build: build configuration:
       source directory: ....../Zephyr/zephyrproject/zephyr/samples/hello_world
       build directory: ....../Zephyr/zephyrproject/zephyr/build
       BOARD: hifive1_revb (origin: command line)
-- west build: generating a build system
Zephyr version: 1.14.99
-- Selected BOARD hifive1_revb
-- Found west: ~/.local/bin/west (found suitable version "0.6.0", minimum required is "0.5.6")
CMake Error at ....../Zephyr/zephyrproject/zephyr/cmake/host-tools.cmake:69 (message):
  message called with incorrect number of arguments
Call Stack (most recent call first):
  ....../Zephyr/zephyrproject/zephyr/cmake/app/boilerplate.cmake:414 (include)
  CMakeLists.txt:5 (include)


CMake Error at ....../Zephyr/zephyrproject/zephyr/cmake/host-tools.cmake:70 (string):
  string sub-command REGEX, mode MATCH needs at least 5 arguments total to
  command.
Call Stack (most recent call first):
  ....../Zephyr/zephyrproject/zephyr/cmake/app/boilerplate.cmake:414 (include)
  CMakeLists.txt:5 (include)


CMake Error at ....../Zephyr/zephyrproject/zephyr/cmake/extensions.cmake:1324 (message):
  Assertion failed: The detected dtc version is unsupported.

      The version was found to be 0.6.0                                   
      But the minimum supported version is 1.4.6                        
      See https://docs.zephyrproject.org/latest/getting_started/                     
      for how to use the SDK's dtc alongside a custom toolchain.
Call Stack (most recent call first):
  ....../Zephyr/zephyrproject/zephyr/cmake/host-tools.cmake:72 (assert)
  ....../Zephyr/zephyrproject/zephyr/cmake/app/boilerplate.cmake:414 (include)
  CMakeLists.txt:5 (include)


-- Configuring incomplete, errors occurred!
ERROR: command exited with status 1: /usr/bin/cmake -B....../Zephyr/zephyrproject/zephyr/build -S....../Zephyr/zephyrproject/zephyr/samples/hello_world -GNinja -DBOARD=hifive1_revb

In my case, it’s because DTC is wrongly and automatically set to:

1	DTC:FILEPATH=/opt/zephyr-sdk/sysroots/x86_64-pokysdk-linux/usr/bin/dtc

even if

➜  zephyr whereis dtc
dtc: /usr/bin/dtc
➜  zephyr git:(master) ✗ dtc --version
Version: DTC 1.5.0-gb8d6eca7-dirty

Solution 1: Temporary Solution

Reset DTC to value /usr/bin/dtc in file build/CMakeCache.txt

Solution 2: Permanent Solution

Modify file ./cmake/toolchain/zephyr/0.10.1/host-tools.cmake as follows

Replace set(HOST_TOOLS_HOME ${ZEPHYR_SDK_INSTALL_DIR}/sysroots/${TOOLCHAIN_ARCH}-pokysdk-linux) with set(HOST_TOOLS_HOME /usr)
Remove list(APPEND CMAKE_PREFIX_PATH ${HOST_TOOLS_HOME}/usr)
Replace set_ifndef(QEMU_BIOS ${HOST_TOOLS_HOME}/usr/share/qemu) with set_ifndef(QEMU_BIOS /usr/local/share/qemu)
Replace set_ifndef(OPENOCD_DEFAULT_PATH ${HOST_TOOLS_HOME}/usr/share/openocd/scripts) with set_ifndef(OPENOCD_DEFAULT_PATH /usr/local/share/openocd/scripts)

Then, rebuild everything with west build -b hifive1_revb samples/hello_world.

2. Running Zephyr on SiFive HiFive1 Rev B01

2.1 Connect SiFive HiFive1 Rev B01

Now, let’s plug in SiFive HiFive1 Rev B01 with a QUALIFIED Micro-B USB to USB Type A cable. SiFive HiFive1 Rev B01 will be prompted as a massive storage hard drive as:

HiFive1 Content	Readme.html

Readme.html shows the following message:
This board uses SEGGER J-Link OB technology to connect to the target CPU.
More information

, and lsusb shows a SEGGER device:

➜  ~ lsusb
......
Bus 001 Device 010: ID 1366:1051 SEGGER 
......

2.2 Flash SiFive HiFive1 Rev B01

➜  build git:(master) ✗ west flash
-- west flash: rebuilding
ninja: no work to do.
-- west flash: using runner jlink
-- runners.jlink: Flashing Target Device
SEGGER J-Link Commander V6.48b (Compiled Aug  2 2019 10:20:30)
DLL version V6.48b, compiled Aug  2 2019 10:20:19


J-Link Command File read successfully.
Processing script file...

J-Link connection not established yet but required for command.
Connecting to J-Link via USB...Updating firmware:  J-Link OB-K22-SiFive compiled Jul 30 2019 12:24:12
Replacing firmware: J-Link OB-K22-SiFive compiled Mar 15 2019 12:47:14
Waiting for new firmware to boot
New firmware booted successfully
O.K.
Firmware: J-Link OB-K22-SiFive compiled Jul 30 2019 12:24:12
Hardware version: V1.00
S/N: 979000238
VTref=3.300V
Target connection not established yet but required for command.
Device "FE310" selected.


Connecting to target via JTAG
ConfigTargetSettings() start
ConfigTargetSettings() end
TotalIRLen = 5, IRPrint = 0x01
JTAG chain detection found 1 devices:
 #0 Id: 0x20000913, IRLen: 05, Unknown device
Debug architecture:
  RISC-V debug: 0.13
  AddrBits: 7
  DataBits: 32
  IdleClks: 5
  Stat: 0
Memory access:
  Via system bus: No
  Via ProgBuf: Yes (16 ProgBuf entries)
DataBuf: 1 entries
  autoexec[0] implemented: Yes
Detected: RV32 core
CSR access via abs. commands: No
Temp. halted CPU for NumHWBP detection
HW instruction/data BPs: 8
Support set/clr BPs while running: No
HW data BPs trigger before execution of inst
RISC-V identified.
Reset delay: 0 ms
Reset type Normal: Resets core & peripherals using <ndmreset> bit in <dmcontrol> debug register.

Downloading file [....../zephyrproject/zephyr/build/zephyr/zephyr.bin]...
Comparing flash   [100%] Done.
Erasing flash     [100%] Done.
Programming flash [100%] Done.
Verifying flash   [100%] Done.
J-Link: Flash download: Bank 0 @ 0x20000000: 1 range affected (65536 bytes)
J-Link: Flash download: Total time needed: 1.157s (Prepare: 0.081s, Compare: 0.318s, Erase: 0.128s, Program: 0.298s, Verify: 0.318s, Restore: 0.012s)
O.K.



Script processing completed.

2.3 Demonstrate Via Serial Port

By following HiFive1 Rev B01 Getting Started Guide, Chapter 6 Section 2: Console Configuration, we’ll have:

➜  ~ tail -n 15 -F /etc/udev/rules.d/99-jlink.rules
ATTR{idProduct}=="106b", ATTR{idVendor}=="1366", ENV{ID_MM_DEVICE_IGNORE}="1"
ATTR{idProduct}=="106c", ATTR{idVendor}=="1366", ENV{ID_MM_DEVICE_IGNORE}="1"
ATTR{idProduct}=="106d", ATTR{idVendor}=="1366", ENV{ID_MM_DEVICE_IGNORE}="1"
ATTR{idProduct}=="106e", ATTR{idVendor}=="1366", ENV{ID_MM_DEVICE_IGNORE}="1"
ATTR{idProduct}=="106f", ATTR{idVendor}=="1366", ENV{ID_MM_DEVICE_IGNORE}="1"
#
# Make sure that VCOM ports of J-Links can be opened with user rights
# We simply say that all devices from SEGGER which are in the "tty" domain are enumerated with normal user == R/W
#
SUBSYSTEM=="tty", ATTRS{idVendor}=="1366", MODE="0666", GROUP="dialout"
#
# End of list
#
SUBSYSTEM=="tty", ATTRS{idVendor}=="1366", ATTRS{idProduct}=="1051", MODE="664", GROUP="plugdev"
LABEL="jlink_rules_end"
➜  ~ groups
lvision adm dialout cdrom sudo dip plugdev lpadmin sambashare
➜  ~ ll /dev/ttyACM*
crw-rw-rw- 1 root dialout 166, 0 Aug  7 00:05 /dev/ttyACM0
crw-rw-rw- 1 root dialout 166, 1 Aug  6 23:10 /dev/ttyACM1

Let’s start monitoring the serial port by:

1	➜ ~ screen /dev/ttyACM0 115200

HiFive1 Rev B01 Serial Port screen

The CORRECT demo should give the following ERROR message:

Bench Clock Reset Complete

ATE0-->ATE0
OK
AT+BLEINIT=0-->OK
AT+CWMODE=0-->OK

***** Booting Zephyr OS build zephyr-v1.14.0-2842-g0440a815a91b *****
Hello World! hifive1_revb

However, I’ve got NO idea why sometimes there is an Send Flag error:

1	ATE0--> Send Flag error: #0 #0 #0 #0 AT+BLEINIT=0-->AT+BLEINIT=0

It seems the messages are from bootloader, sometimes it fails to initialize ESP32 module.

Alright, it’s TOO late already. I’ll have to go to bed… ALL the BEST to my classmate.

Electrocardiography (ECG)

Posted on 2019-07-27 | Edited on 2019-08-18 | In Medical

Just finished reviewing a paper talking about Electrocardiography (ECG) biometrics 10 minutes ago. Let’s continue having some fun of ECG right away.

Fundamental Knowledge About ECG

Details can be found on ACLS Medical Training. Let’s cite the key graph as follows:

ECG Basics

BioSPPy

BioSppy is a Python tool which can display various types of biosignals. Its source code can be found on github.

Installation

➜  ~ pip install -U biosppy --user
......
➜  ~ pip show biosppy
Name: biosppy
Version: 0.6.1
Summary: A toolbox for biosignal processing written in Python.
Home-page: https://github.com/PIA-Group/BioSPPy
Author: Instituto de Telecomunicacoes
Author-email: carlos.carreiras@lx.it.pt
License: BSD 3-clause
Location: /home/lvision/.local/lib/python3.7/site-packages
Requires: scipy, numpy, matplotlib, scikit-learn, h5py, six, shortuuid, bidict
Required-by:

Test

A sample ECG data can be found at BioSPPy example.

from biosppy import storage
from biosppy.signals import ecg

# load raw ECG signal
signal, mdata = storage.load_txt('./examples/ecg.txt')

# process it and plot
out = ecg.ecg(signal=signal, sampling_rate=1000., show=True)

ECG Summary

Nobody

Longer Vision Technology Github Blog